METHOD, APPARATUS AND SYSTEM FOR VIDEO 
DELIVERY USING HEAD-END PASS THROUGH 



BACKGROUND OF THE INVENTION 

5 

TECHNICAL FIELD 

This invention pertains to the field of distribution of cable video signals from a 
head-end to a set -top box. 

10 DESCRIPTION OF THE PRIOR ART 

Cable television distribution systems were originally developed to bring 
television signals to geographically isolated communities. The isolated 
communities found that the quality of their television service was in many 
aspects superior to that of their city counterparts that received television 
15 signals off the ain/vaves. Because of this superior quality, cable television 
service was able to penetrate urban communities where television reception 
was otherwise available. Suffice it to say that cable television systems have 
proliferated widely and today many households enjoy the benefits of a cable 
television connection. 

20 

Cable television has many intrinsic advantages over off-air reception, 
especially in the field of digital television. Where off-air transmission must 
contend with a problematic medium, i.e. open air space, cable television 
offers a controlled distribution system. Problems such as multi-path errors are 
25 simply non-existent or are easily contained. Given the regulated nature of the 
delivery medium, cable television is much more suited to digital transmission. 



In digital television, compressed digital video signals are conveyed to 
subscribers attached to the cable system. The digital video signals can be 
referred to as program streams. Subscribers can select one of a number of 
5 program streams carried on the cable. A modulated carrier is used to transmit 
digital information to the subscribers. The most common form of modulation 
is a multi-state modulation technique. Multi-state modulation techniques allow 
more than two states to be represented by modulating either the amplitude of 
the carrier, the phase of the carrier or both. One modulation technique that 
10 modulates both amplitude and phase is called quadrature amplitude 
modulation (QAM). 

By using a QAM modulated carrier, the cable television distribution system is 
15 able to transmit massive amounts of digital information in short time frames. 
In a simple but relevant comparison, upwards of fifteen digital program 
streams can be transmitted in the bandwidth normally allocated to just one 
analog television channel. This expanded bandwidth capability has caused 
some to envision systems where the cable television distribution system is 
20 used not only for digital television, but delivery of high speed data services as 
well. These visions have led to modern cable systems that offer Internet 
access as part of the suite of services offered to subscribers. 

Integrating the Internet with television programming is the next plateau. Using 
25 a software tool called a browser, subscribers can retrieve web pages from a 
server. These web pages are presented to a subscriber on the television 
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screen and the subscriber can navigate through web pages using buttons on 
a remote control. True integration of the Internet with video programming 
demands that subscribers select video programs through hyperlinks on a web 
page. The hyperlinks can then reference either video streams, such as would 
5 be the case with a broadcast channel, or video files. In the latter case, a true 
video-on-demand system can be realized. 

One unfortunate artifact of the integrated Internet-Television paradigm is that 
all data received from the head-end is received using a network protocol. In 

10 many cases, the TCP/IP protocol is used. This network oriented data delivery 
scheme is imputed not only to web pages, but to program video as well. To 
realize this type of functionality, each subscriber must be outfitted with a 
rather sophisticated, and therefore expensive set top box. The set top box 
must include a high-speed processor coupled to a graphics controller. The 

15 high-speed processor is also coupled to a network interface that allows 
communication with the head-end. In this prior art scheme, the set top box 
functions as a web browser much akin to a personal computer connected to 
the Internet. 

20 Because cable television services are extremely cost sensitive, it is desirable 
to reduce the cost of the set top box. But doing so is contra to the processing 
performance needed to support the integrated Internet-Television paradigm. 
One novel method for reducing the need for processing power at the set top 
box has been disclosed in the Applicants prior application entitled "SYSTEM 

25 AND METHOD OF A MULTI-DIMENSIONAL PLEX COMMUNICATION NETWORK AND 

NODE THEREOF", serial no. 09/679, 115. In that disclosure, a cable television 
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head-end is described that comprises a suite of loosely coupled processors. 
The loosely coupled processors communicate with each other using high- 
speed network connections to form a large array. This array of processors 
offers economies of scale that can not be achieved in the alternative where 
5 high-performance set top boxes are installed at each subscriber site. Installed 
in a central facility, the head-end can economically contend with browser 
execution and high-speed network interface. 

The head-end processor array is able to support a plurality of simultaneous 
10 web browser Instantiations. Each instance of a browser services one 
subscriber in the cable television system. Each instance of the browser has 
high-speed and immediate access to the Internet, enabling true video-on- 
demand and streaming video reception. The browser renders its graphic 
output to local memory within the head-end processing array. That graphic 
15 output is sampled periodically to create a sequence of image frames. These 
image frames are then compressed into a digital video stream. The digital 
video stream is then conveyed to the subscriber using the cable television 
distribution system. The set top box still needs a processor, but the 
computational requirement is greatly reduced. The set top box need only be 
20 capable of receiving digital television and this can be readily accommodated 
using a low-performance processor augmented by a low-cost, hardware 
based video stream decompressor. 

The prior method exploits the ability of one processor in the processor array to 
25 execute a plurality of browser instantiations. The subscriber is presented with 
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a video representation of the browsers' graphical output so that the set top 
box is not concerned with the execution of the browser or interface to a 
computer network. These features reduce the per-subscriber cost associated 
with integrated Internet services, but this method is compromised whenever 
5 video must be presented to the subscriber. Presenting video in a browser 
window implies that the video must be decompressed and then rendered into 
a video graphics window. In the centralized approach, the output of the 
browser, which then Includes the rendered video program, must be 
compressed so that it can be transmitted to a less sophisticated set top box 

10 as a digital video stream. Herein lies the conundrum, using a centralized 
processor array to execute the browsers is efficient, but processing video is 
inefficient because once the video is decompressed, it must be rendered and 
then again recompressed so that it can be sent to the set top box. The need 
to decompress the video signal and then recompress that signal once it is 

15 rendered and merged into a graphic window is not only computationally 
wasteful and provides no sealing benefits. 

What is needed Is a method that not only takes advantage of the centralized 
execution of the browser software, but also eliminates the need to 

20 decompress video programs and then recompress them almost immediately 
thereafter. This method of the invention does this. A processor array located 
In a head-end executes a plurality of browser Instantiations. Video streams 
that are received by the browser are not processed by the browser. Rather, 
they are forwarded to the set top box together with information pertinent to 

25 their presentation within the browsers' graphical output. When received at the 



set top box, the video streams can be decompressed in a manner analogous 
to that of a digital television stream. 

5 SUMMARY OF THE INVENTION 

The present invention comprises a method and apparatus for delivering video 
to a subscriber wherein the video is integrated into a web browsing session. 
The apparatus comprises a system for delivering video according to the 
10 method. The system comprises a head-end, a plurality of set top boxes and a 
distribution system. The invention further comprises the individual system 
elements, i.e. a head-end and a set top box that implement the method of the 
present invention. 

15 The system executes web browsers in a central head-end. A browser is a 
software element that receives page addresses from the subscriber, retrieves 
the description for the referenced pages and renders a graphical image 
according to the page description. The page address is received from the 
subscriber either by means of a navigation entry or a hyperlink. In the 

20 preferred embodiment, the page description is written in a page description 
language such as Hyper Text Markup Language, but any alternative mark-up 
language can be used. 

The browser executes in the head-end and renders a page image description 
25 frame by interpreting the page description. This graphical output is sampled 
on a periodic basis to form a sequence of image frames. The image frames 
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are directed to a compression mechanism in the head-end that creates a 
page description video stream. This page description video stream is then 
transmitted to the set top box where it is received and written to a display 
memory. Where program video must be integrated with the web page, a 
5 video source is received by the head end. The video source can be a 
compressed digital video stream. The Moving Picture Experts Group (MPEG) 
is one standard compression format and this is the compression format used 
in the preferred embodiment. Instead of rendering the program video in the 
centrally executed browser, the program video is merely routed to the set top 
10 box. This avoids an unnecessary decompression-recompression step that is 
computationally wasteful and that can degrade the quality of the video 
program. 

The compression mechanism operating in the head-end is capable of creating 
15 a key frame based on the page description video stream. The set top box 
receives either the key frame or the page description video stream both of 
which depict the graphical output created by browser according to the page 
description. The set top box will then decompress either the page image 
description key frame or video stream and write the image into a display 
20 memory. The display memory is partitioned into planes comprising an overlay 
plane and a background plane. The page image description is normally 
written into the background plane. Program video that is routed to the set top 
box by the head-end is received and also written into the display memory. In 
the case of program video, the rendered images are written into the overlay 
25 memory plane such that the image of the video program is set forth on a non- 
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transparent region of the overlay plane. The remainder of the overlay plane is 
made transparent so that the page description graphics written to the 
background plane can be displayed. 



5 In an alternative embodiment, the program video can be rendered to the 
background plane and the overlay plane can be used to display the page 
image description for the web page. In this alternative, the overlay plane is 
made transparent only in the region corresponding to the program video 
presentation occurring in the background plane. Note that some video 
10 formats require translation to an MPEG 2 format that is suitable for a set top 
box. In the invention, that translated output is cached. This technique 
provides caching benefits for large-scale systems. 

The page image description key frame or video stream is conveyed to the set 
15 top box using a multi-state modulated radio frequency carrier. Multi-state 
modulated carriers vary either the amplitude, the phase or the amplitude and 
phase of the carrier in order to represent the data being sent, in all of these 
variations, the number of states in any given modulation interval is more that 
one. In the preferred embodiment, quadrature amplitude modulation is used. 
20 A plurality of carriers operating at different frequencies can be propagated by 
the distribution system and a tuner is used in the set top box to select a 
desired carrier by its frequency. Program video is also transmitted to the set 
top box using this technique. In one alternative embodiment, the page 
description key frame can be directed to the set top box using a separate 
25 digital interface. This is the so-called out-of-band method. 



According to the method of the present invention, a graphics controller in the 
set top box comprises a hardware decompressor that reconstitutes 
compressed image frames and writes these into the display memory. A 

5 software decompressor can support the method just as well. In either case, 
the decompressor can accept a display region in the form of a sized rectangle 
placed on the display screen or in the form of two diagonally opposing corners 
of a rectangle. The decompressor will then scale and render the video into 
the display region. One key aspect of the present invention is the capability of 

10 the set top box to distinguish between page description and program video. 
Page description video is frozen in the background plane after a web page 
graphic is fully rendered by the web browser executing in the head-end. In 
the preferred embodiment, a key frame is created when the web browser 
completes the page rendering process. The key frame can then be directly 

15 conveyed to the set top box and subsequently written into the background 
memory plane. 



BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a block diagram that depicts centralized browser execution 
according to the present invention; 



Fig. 2 is a block diagram of a set top box according to the present 
25 invention; 
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Fig. 3 is a flow diagram that depicts the method of delivering web page 
graphics and program video to a set top box when the program video 
must be integrated into the web page; 

5 Fig. 3A is a block diagram depicting a video pass through mechanism 
according to the present invention; 

Fig. 4 is a pictorial diagram of an exemplar video program selection 
menu background graphic; and 

10 

Fig. 5 is a pictorial diagram that depicts the overlay of video on top of a 
background graphic. 



15 

DETAILED DESCRIPTION OF THE INVENTION 

Fig. 1 is a block diagram that depicts centralized browser execution according 
to the present invention. A head-end 10 comprises a processor array that is 

20 able to execute a plurality of browser or browser services 20. One instance of 
the browser 20 is launched for each subscriber using a set top box 15. Each 
browser 20 in the head-end 1 0 generates a graphic output whenever a new 
page description is interpreted and thereafter rendered. The graphic output is 
sampled on a periodic basis and/or when content has been updated and each 

25 such sample is called a frame. The frames are sequentially routed to a video 
compressor. The video compressor uses the frames to create a compressed 
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video stream for each browser. This video stream is called the page 
description video stream. Each of these page description video streams is 
then delivered to the corresponding set top box 15. The set top box 15 
receives the video program stream, decompresses the video and presents it 
5 on a television screen viewed by a subscriber. 

Upon initiation, each browser will retrieve a page description for a start-up 
page. The page description is written in a page description language. In the 
preferred embodiment, the Hyper-Text Markup Language (HTML) is used but 

10 any suitable markup language or extension thereof may be used. The 
browser executes in the head-end and renders a page image in a specialized 
rendering memory. The rendering memory is sampled on a periodic basis to 
produce a sequence of frames. These frames constitute the basis of a page 
description video stream. This process continues until the browser 

15 recognizes a need to present a program video stream in a browser window. 
Program video is distinguished from page description video in that program 
video is received either from a static file or from a streaming source. 

Any digital video stream is normally conveyed to the set top box by way of a 
20 radio frequency (RF) carrier signal. In the preferred embodiment, the data 
stream modulates the carrier in order to produce a plurality of discrete states 
in a given interval of time. This type of modulation is referred to as multi-state 
modulation. Multi-state modulation comprises variation of either the 
amplitude, the phase or both amplitude and phase of a signal in a plurality of 
25 discrete quantum. Once such modulation method commonly used in cable 
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television systems is quadrature amplitude modulation (QAM). QAM 
modulation varies the amplitude and the phase of a carrier wave according to 
the data. A QAM modulated signal is capable of carrying a plurality of video 
program streams. The program streams are time multiplexed prior to 
5 modulation of the carrier signal. The distribution system 25 can carry a 
plurality of modulated carriers; each centered at a different frequency. 

Fig. 2 is a block diagram of a set top box according to the present invention. 
In the preferred embodiment, the set top box 15 receives video signals that 

10 are carried on a radio frequency carrier wave. A tuner 30 receives RF energy. 
The tuner 30 selectively amplifies a carrier at a particular frequency while 
rejecting unwanted carriers at other frequencies. The selected carrier is then 
delivered to a multi-state demodulator 35. In the preferred embodiment a 
QAM demodulator is used. Because any given video program stream is time 

15 multiplexed with other program streams, a program identifier (PID) selector 40 
is used to extract the desired video program stream. The output of the PID 
selector 40 comprises a compressed digital video stream. In the present 
embodiment, the compressed digital video stream comprises an MPEG 
stream. 

20 

The MPEG, or other compressed video program stream is directed either 
directly to a graphics controller 50 or to a central processing unit (CPU) 45. In 
the preferred embodiment, the graphics controller 50 comprises a hardware 
decompressor that accepts a sequence of compressed digital image frames 
25 and reconstitutes frame images by decompressing the sequence. In the case 
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of a video program stream such as MPEG, the sequence of digital image 
frames comprises an initial image frame followed by a plurality of update 
frames. Each update frame carries information regarding the difference 
between the current image and the initial image frame. The graphics 
5 controller 50 writes the uncompressed frame images to the display memory 
55 as they emerge from the decompression process. 

In an alternative embodiment, the CPU 45 receives the sequence of digital 
image frames from the PID selector 40 and executes an instruction sequence 

10 that comprises a software decompressor. In this case, the output of the 
software decompressor is then directed directly to the graphics controller 
display memory 55. Once the image of a frame is written to the graphics 
memory 55 by either the CPU 45 or the hardware decompressor in the 
graphics controller 50, the graphics controller 55 creates a video signal that is 

15 delivered to a television set. 

One key feature of the decompression capability provided either by the 
graphics controller 50 or the software decompression algorithms is the ability 
to render the video output to a specific portion of the display memory. This 

20 means that the decompression mechanism can accept a screen boundary 
wherein the video signal will be presented. The extents of the screen 
boundary can be specified either as a rectangle size together with the location 
of the rectangle or it can be specified by the location of two diagonally 
opposing corners of the rectangle. The hardware and software 

25 decompressors include a scaling engine that scales the rendered video output 
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so as to fit the display extents. This aspect of the invention applies to 
transparency and/or windowing. 

According to the present invention, the graphics controller 50 has the ability to 
5 partition the display memory 55 into display planes. The display memory 55 
partition can be accomplished either logically or physically. In the present 
embodiment, the display memory 55 is partitioned into at least an overlay 
plane 60 and a background plane 70. In some embodiments, an intermediate 
memory plane 65 can be established. In operation, any image written into the 

10 overlay plane 60 will be presented on the display screen to the exclusion of 
any other image written to either the background plane 70 or the intermediate 
plane 65. The overlay plane 60 further comprises a plurality of transparency 
zones. Each of these transparency zones, once specified, causes the image 
written in the overlay plane 60 within that zone not to be displayed on the 

15 display screen. The intermediate plane 65, if used, also comprises a plurality 
of transparency zones. The transparency zones in the intermediate plane 65 
can have varying degrees of transparency. 

Fig. 3 is a flow diagram that depicts the method of delivering web page 
20 graphics and program video to a set top box when the program video must be 
integrated into the web page. Given the fact that the problem to be solved 
pertains to the delivery of video that is presented during a browser session, 
the first step (step 1 00) in the process is to render a graphic image for a web 
page. The web page Is authored in a mark up language such as Hyper Text 
25 Markup Language (HTML). In operation, this web page will probably be an 
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index page having one or more hyperlinks to video content. These hyperlinks 
can reference either streaming sources or static files. Where the hyperlink 
references a streaming source, the source can be a broadcast source. In the 
case where the hyperlink references a static source, that file may be a video- 
5 on-demand selection. 

Fig. 3A is a block diagram depicting a video pass through mechanism 
according to the present invention. The graphic image for a web page 
description 22 is rendered by the web browser 20 and placed in a rendering 

10 memory 142 located in the head-end. Ordinarily or when content is updated, 
a frame sampler 144 captures the state of the rendering memory 142 on a 
periodic basis. The sample period is commensurate with the frame rate for a 
television video signal. The frame sampler 144 forwards sequential frame 
images to a compressor 146. The compressor 146 creates and delivers a 

15 page description video stream to a carrier modulator 147. The carrier 
modulator 147 modulates a carrier and delivers this modulated signal to the 
distribution system. This mechanism continuously delivers a video 
representation of the web browsers' graphical output to a set top box. This is 
called the page description video stream. 

20 

Fig. 3 further shows that once a web page 22 is rendered (step 100), the 
compressor 146 is instructed to create a key frame (step 105). The key frame 
is created only when the web browser recognizes that a program video 
stream 24 must be integrated into the web page, i.e. when a browsing session 
25 includes a video stream. The head-end will send the page image description 
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key frame to the set top box (step 110). The browser 20 will then determine 
the size of the video presentation window and its location on the display 
screen (step 115). The window extents are also sent to the set top box (step 
120). 

5 

Once the subscriber selects one of the hyperlink video program references, 
the browser 20 running in the head-end will retrieve the data from the program 
video source 24 or alternatively translated content may be cached and the 
hyperlinks rewritten to the cache location of the content. The browser will not 
10 decompress the program video stream. Rather, the browser 20 will route the 
program video stream directly to the carrier modulator 147 and command the 
carrier modulator to ignore the output of the compressor 146. The carrier 
modulator will modulate the carrier with the program video stream and deliver 
it to the distribution system. 

15 

The set top box receives the page description key frame (step 125). The set 
top box is able to distinguish the key frame from the ordinary page description 
video stream it regularly receives from the head-end. The page description 
key frame is decompressed and written to the display memory, specifically 
20 into the background plane 70. All video stream data arriving at the set top box 
subsequent to the arrival of the page description key frame is treated as 
program video. 

Program video arriving at the set top box 15 (step 135) is routed to either the 
25 hardware decompressor in the graphics controller 50 or is processed by the 
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software decompressor executed by the CPU 45. The hardware and software 
decompressors will render digital frame images depicting the program video 
into the overlay plane 60 (step 140). The decompressors will honor the 
display extents received in step 130 and will scale the program video to the 
5 size specified by the display extents. A special command issued by the 
browser and received by the set top box resets the graphics controller 50 so 
that the video streams are again directed to the background plane 70. This 
reset command also causes the entire overlay plane 60 to be made 
transparent. 

10 

Fig. 4 is a pictorial diagram of an exemplar video program selection menu 
background graphic. The program selection menu background graphic 
depicts the display output as created by a web browser. The background 
graphic may contain a plurality of navigation controls such as forward and 

15 back buttons 160 and 165. The background graphic may further comprise a 
navigation address box 175. At least one hyperlink 180 will be contained in 
the page description. It should be noted that the substance of the menu page 
depicted in Fig. 4 and described herein is for illustrative purposes only and 
can be varied to meet specific requirements that may pertain to specific 

20 system operators and/or subscribers. In this illustrative example, the 
hyperlink 180 is a rectangular region. In this example, the rectangular region 
also depicts the extent and location at which the program video must be 
presented on the subscribers display. 

25 Fig. 5 is a pictorial diagram that depicts the overlay of video on top of a 
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background graphic. As previously described, any background graphic is 
rendered by the browser 20 executing in the head-end 10. This background 
graphic is conveyed to the set top box 15 as a key frame. This page image 
frame description 150 is written into the background display memory plane 70. 

5 Once the set top box receives the key frame, program video is directed to the 
overlay display plane 60. The overlay display plane 60 is made transparent 
185 except for a non-transparent region 190. The non-transparent region 190 
comprises the region corresponding to the display extents for the program 
video presentation. The graphics controller 50 will create a composite output 

10 comprising the non-transparent overlay region 190 together with the contents 
of the background plane 70. This results in presentation of the video program 
stream on top of the background web page. 

Alternative Embodiments 

15 

While this invention has been described in terms of several preferred 
embodiments, it is contemplated that alternatives, modifications, 
permutations, and equivalents thereof will become apparent to those 
skilled in the art upon a reading of the specification and study of the 
20 drawings. It is therefore intended that the true spirit and scope of the 
present invention include all such alternatives, modifications, 
permutations, and equivalents. Some, but by no means all of the possible 
alternative embodiments are described herein. 

25 Each browser receives a program video stream from some source. In the 
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present embodiment, compressed video streams are encoded according to 
the Moving Picture Experts Group (MPEG-2) standard. It should be noted 
that any compression standard could be used. 

5 In the preferred embodiment, the background page description is delivered to 
the set top box using a portion of the bandwidth used to transport program 
video to the set top box. This method can be supplanted by delivering the 
background image representing the output of the web browser 20 by using an 
ancillary digital Interface. 

10 

Also in the preferred embodiment, the web page rendered by the browser 20 
is received by the set top box 15 and is written to the background plane 70. In 
this preferred embodiment, the video program stream is rendered into the 
overlay plane 60. As an alternative to this, the video could be rendered into 

15 the background plane 70. In this case, the overlay plane 60 is made 
transparent only in the video presentation region as depicted by the display 
extents. Other permutations of this method would render the video program 
into an intermediate plane 65. In this case, the page image description 
rendered by the browser 20 could be written into the overlay plane 60 or the 

20 background plane 70 with the proper opacity adjustments made to the proper 
planes to achieve the video overlay effect described herein. 

The set top box 1 5 receives a key frame as an indication that the incoming 
video stream is shifting from browser graphic output to program video. The 
25 key frame is generated from the page description video stream generated by 
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the compressor 146. The set top box can continue to receive the page 
description video stream into the background memory plane 70 until the web 
browser 20 has fully rendered a web page that must be integrated with 
program video. Once this is done, the browser could issue a command to the 
5 set top box to hold the latest image in the background memory 70. This 
command would signal the graphics controller 50 that the video stream should 
be regarded as program video and that the video stream should be directed to 
the overlay plane 60. 

10 One benefit of the invention Is that it offers a significant scaling benefit for a 
large scale system. When a translation (compression) is performed from a 
native format to a target, e.g. set top box, format a statistical analysis may be 
used to determine whether or not translated content should be cached, e.g. 
based upon popularity. A link to this content is then rewritten to access the 

15 cache instead of the source, and a compute intensive translation for future 
access to the content is avoided because the previously translated, and now 
cached, version of the content is available. 

Accordingly, although the invention has been described in detail with 
20 reference to particular preferred embodiments, persons possessing ordinary 
skill in the art to which this invention pertains will appreciate that various 
modifications and enhancements may be made without departing from the 
spirit and scope of the claims that follow. 

25 

20 



